Multimodal Lip-Reading for Tracheostomy Patients in the Greek Language

نویسندگان

چکیده

Voice loss constitutes a crucial disorder which is highly associated with social isolation. The use of multimodal information sources, such as, audiovisual information, since it can lead to the development straightforward personalized word prediction models reproduce patient’s original voice. In this work we designed approach based on from patients before loss-of-voice develop system for automated lip-reading in Greek language. Data pre-processing methods, lip-segmentation and frame-level sampling techniques were used enhance quality imaging data. Audio was incorporated model automatically annotate sets frames as words. Recurrent neural networks trained four different video recordings robust model. able correctly identify test words time 95% accuracy. To our knowledge, first that recognize

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Lip Reading in the Wild

Our aim is to recognise the words being spoken by a talking face, given only the video but not the audio. Existing works in this area have focussed on trying to recognise a small number of utterances in controlled environments (e.g. digits and alphabets), partially due to the shortage of suitable datasets. We make two novel contributions: first, we develop a pipeline for fully automated large-s...

متن کامل

critical period effects in foreign language learning:the influence of maturational state on the acquisition of reading,writing, and grammar in english as a foreign language

since the 1960s the age effects on learning both first and second language have been explored by many linguists and applied linguists (e.g lennerberg, 1967; schachter, 1996; long, 1990) and the existence of critical period for language acquisition was found to be a common ground of all these studies. in spite of some common findings, some issues about the impacts of age on acquiring a second or...

15 صفحه اول

Lip Reading in Profile

There has been a quantum leap in the performance of automated lip reading recently due to the application of neural network sequence models trained on a very large corpus of aligned text and face videos. However, this advance has only been demonstrated for frontal or near frontal faces, and so the question remains: can lips be read in profile to the same standard? The objective of this paper is...

متن کامل

passivity in waiting for godot and endgame: a psychoanalytic reading

this study intends to investigate samuel beckett’s waiting for godot and endgame under the lacanian psychoanalysis. it begins by explaining the most important concepts of lacanian psychoanalysis. the beckettian characters are studied regarding their state of unconscious, and not the state of consciousness as is common in most beckett studies. according to lacan, language plays the sole role in ...

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computers

سال: 2022

ISSN: ['2073-431X']

DOI: https://doi.org/10.3390/computers11030034